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ABSTRACT 

The  purpose  of  this  thesis  was  to  apply  computer  compatible 
decision  techniques  to  the  problem  of  selecting  a  recipient  for 
the  Rear  Admiral  John  J.  Shieffelin  Award  for  Excellence  in 
Teaching  at  the  Naval  Postgraduate  School. 

These  computerized  techniques  were  used  to  analyze  the 
data  from  the  ballots.   The  balloting  process  is  described  and 
computer  programs  are  presented.   Special  studies  were  made 
using  Kendell's  coefficient  of  concordance.   Their  purpose  was 
to  investigate  the  issue  of  whether  students  and  alumni  rank 
faculty  members  in  the  same  way.   In  addition  the  ranking  of 
faculty  members  across  years  was  studied.   The  results  of  this 
part  of  the  study  was  that,  on  a  statistical  basis,  it  can  be 
stated  that  the  student  and  alumni  ratings  of  faculty  are 
similar  and  faculty  rankings  have  been  stable  over  the  three 
years  the  award  has  been  presented. 
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I.   INTRODUCTION 

In  this  paper  the  history  of  the  Shieffelin  Award  for 
Excellence  in  Teaching  at  the  Naval  Postgraduate  School  is 
discussed  and  the  process  involved  in  selecting  the  winner 
is  explained.   This  process  of  selecting  the  outstanding 
teacher  consisted  of  design  and  distribution  of  ballots, 
validation  of  ballots,  collection  of  data,  and  computerized 
techniques  used  to  analyze  data.   These  techniques  are  ex- 
plained and  the  results  are  examined  later  in  this  thesis. 

Two  statistical  studies  were  conducted.   The  first  was 
to  determine  if  students  and  alumni  within  this  years  1972 
voting  population  ranked  teachers  in  a  similar  manner.   The 
second  study  was  made  to  determine  if  the  ranking  of  teachers 
(by  students)  this  year  was  consistent  with  the  ranking  of 
teachers  (by  students)  in  all  previous  years. 


II.   THE  COMMITTEE 

The  Award  for  Excellence  in  Teaching  was  established  in 
May  1969  by  Rear  Admiral  Robert  W.  McNitt,  USN,  and  awarded 
for  the  first  time  in  June  of  1970.   At  the  time  that  the 
award  was  established  a  faculty  committee  was  formed.   The 
objective  of  this  committee  was  to  select  a  recipient  for 
the  outstanding  teaching  award  to  be  presented  each  year 
during  the  June  graduation  exercise. 

The  Superintendent  of  the  Naval  Postgraduate  School, 
Rear  Admiral  A.  S.  Goodfellow,  USN,  on  1  March  1972  sent  a 
letter  to  the  Alumni  members  of  the  1970  graduation  classes. 
Part  of  this  letter  stated ... "This  June  an  award  for  excel- 
lence in  teaching  for  the  third  time  will  be  given  to  a  member 
of  our  faculty,  civilian  or  military.   This  award  is  now  known 
as  the  Rear  Admiral  John  J.  Shieffelin  Award,  and  was  made 
possible  through  a  grant  to  the  Naval  Postgraduate  School 
Foundation.   Previous  winners  of  the  award  are  Professor 
John  N.  Dyer  of  the  Department  of  Physics  and  Professor 
Eugene  C.  Kaderlie  of  the  Department  of  Oceanography.   The 
recipient  is  determined  each  year  through  a  careful  poll  taken 
among  alumni,  students,  and  faculty." 

This  years  recipient  of  the  award  again  was  selected  by  a 
committee  of  seven  faculty  members.   The  committee  was  com- 
posed of  a  Chairman,  Professor  D.  B.  Hoisington;  a  Secretary, 
Associate  Professor  P.  J.  Renard,  and  five  other  members, 


Associate  Professors  R.  H.  Stolfi,  C.  R.  Jones,  Professor 

J.  N.  Dyer,  and  Assistant  Professors  G.  J.  Hokenson  and  G.  L. 

Musgrave. 

The  members  of  this  committee  are  selected  to  provide  a 
wide  variety  of  backgrounds  and  curricula.   Four  persons 
leave  the  committee  each  year  and  are  replaced  by  four  new 
members,  thus,  engendering  new  ideas  and  concepts  in  the 
selection  process  while  retaining  a  core  of  persons  familiar 
with  the  existing  system. 

Again  this  year,  the  committee  decided  to  retain  the 
same  philosophical  outlook  concerning  the  nature  of  excellence 
in  teaching  along  with  how  excellence  in  teaching  should  be 
reliably  identified  and  evaluated.   The  interested  reader 
will  find  this  outlook  in  a  previous  Naval  Postgraduate 
School  thesis.    To  set  the  groundwork  for  this  paper  certain 
guidelines  for  the  selection  process  will  be  discussed.   These 
guidelines  are  as  follows: 

1.  All  faculty  with  the  exception  of  the  Department 
Chairman,  Administrators,  members  of  the  selection 
committee,  and  previous  winners  are  eligible  to 
receive  the  award. 

2.  The  voting  population  includes  all  current  students, 
faculty,  and  Curricular  Officers.   Also  included  in 
this  is  the  group  of  Naval  Officers  which  graduated  in 
1970. 

3.  Participation  in  the  pell  is  entirely  voluntary  and 
no  one  is  required  to  sign  his  ballot. 


Robert  W.  Geary,  "The  First  Annual  Award  for  Excellence 
in  Teaching,  A  Study  of  Procedure  and  Analysis  of  Data" 
(unpublished  Master's  thesis,  U.  S.  Naval  Postgraduate  School, 
Monterey,  California,  1970),  p.  10. 


4.  Care  and  discretion  are  used  to  ensure  no  ranking  of 
candidates  is  published. 

5.  For  the  ballot  to  be  valid  the  voter  must  indicate  that 
he  is  acquainted  with  at  least  five  members  on  the 
candidate  list. 

6.  The  voter  is  cautioned  not  to  vote  on  the  basis  of 
personality  or  popularity  but  on  teaching  ability  and 
performance . 

In  order  to  maintain  objectivity  among  the  selection 
committee  it  was  determined  that  an  individual  from  outside 
the  faculty  would  handle  the  ballots,  collate  the  data  and 
submit  the  results  to  the  selection  committee. 

Only  after  the  committee  selected  the  nominee  for  this 
years  award  was  his  name  made  known  to  the  selection  committee. 
The  nominee's  name  was  then  submitted  to  Rear  Admiral  A.  S. 
Goodfellow  for  final  approval,  and  remained  a  secret  to  all 
others  until  the  award  was  presented  at  the  June  graduation. 


III.   THE  BALLOT 

A .   FORMAT 

An  instruction  sheet  was  attached  to  the  front  of  the 
ballot  to  explain  the  purpose  of  the  award,  give  instructions 

on  how  to  complete  the  ballot,  and  explain  the  requirements 

2 
for  validating  the  ballot. 

The  ballot  itself  was  composed  of  four  parts.   Part  A  was 
a  Data  Processing  aid  to  help  in  the  analysis  of  the  voter 
population  characteristics.   The  voter  was  asked  to  identify 
his  voter  category,  Rank,  Branch  of  Service,  and  Curricular 
area  if  military;  if  Civilian  his  academic  rank  and  department 
were  to  be  circled. 

Part  B  included  three  blanks  to  be  used  in  indicating 
first,  second,  and  third  choices  for  the  award  using  the  four 
digit  identification  number  in  Part  C. 

Part  C  of  the  ballot  identified  all  eligible  faculty 
members  from  which  each  voter  could  select  his  first,  second, 
and  third  choices.   Each  eligible  faculty  member  was  listed 
in  alphabetical  order  under  the  heading  of  his  department. 
The  voter  was  asked  to  circle  a  four  digit  identification 
number  of  all  those  faculty  members  with  whom  he  considered 
himself  to  be  reasonably  well  acquainted  in  an  academic 
capacity. 


2 

A  sample  ballot  and  instruction  sheet  are  included  in 


Appendix  A. 
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The  last  portion  of  the  ballot,  Part  D,  was  to  be  used 
to  comment  on  the  reasons  for  his  selection.   This  portion 
was  not  mandatory,  but  was  considered  beneficial  in' the  final 
selection  processes. 

B.   THE  BALLOTING  PROCESS 

Ballots  were  distributed  to  students  by  utilizing  the 
student  mail  center  (SMC).   The  alumni  group  selected  to 
participate  in  this  years  voting  were  the  Naval  Officers  who 
graduated  in  calendar  year  1970.   Their  names  and  addresses 
were  taken  from  a  data  tape  maintained  in  the  computer 
facility. 

As  an  aid  for  addressing  alumni  ballots,  a  computer 
program  was  written  which  can  be  used  in  the  future.   The 
address  tape  can  now  be  sorted  by  commands  so  that  all 
graduates  with  similar  addresses  will  be  listed.   On  the 
basis  of  this  years  alumni  sample  this  should  mean  a  savings 
of  about  2H%   in  over  all  look  up  time  since  this  process  is 
done  by  hand  the  saving  in  time  is  important. 

Faculty  ballots  were  distributed  by  the  members  of  the 
committee  to  the  appropriate  faculty  mail  center  locations. 

After  voting,  the  completed  ballot  was  placed  in  the 
attached  envelope  addressed  to  the  Superintendent  of  the 
Naval  Postgraduate  School  and  mailed  to  the  committee  member 
in  charge.   The  envelopes  were  coded  55  BAL  to  help  route 
them  to  the  person  assembling  the  data. 
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C.   BALLOT  VALIDATION 


1.   Assembling  the  Data 


As  the  ballots  were  returned  the  validation  process 
for  each  ballot  began.   Each  envelope  contained  an  area  for 
the  voters  signature,  this  was  considered  important  to  ensure 
that  only  one  ballot  was  received  from  each  voter.   The 
envelopes  and  cover  sheets  were  then  discarded. 

The  validation  process  encompassed  counting  to  ensure 
that  Part  C  of  the  ballot  had  at  least  five  identification 
numbers  circled  and  the  nominations  for  first,  second,  and 
third  place  were  valid  nominations.   If  less  than  five  identi- 
fication numbers  were  circled  in  Part  C  the  ballot  was 
considered  void  and  eliminated  from  the  voting  process. 

The  committee  decided  that  when  a  voter  gave  all 
three  votes  to  the  same  teacher  that  the  second  and  third 
place  choices  would  be  nullified.   Each  ballot  was  then  given 
a  four  digit  identification  number  so  that  specific  data  could 
be  retrieved  at  a  later  time. 

Of  1,319  ballots  returned,  1^8  were  deemed  void 
because  a  population  of  five  persons  was  not  specified  by  the 
voter,  and  nine  were  returned  too  late  to  be  processed.   In 
last  years  voting  ballots  were  deemed  void  because  of  write-in 
nominations  of  ineligible  faculty  members;  however,  this  year's 
committee  decided  to  process  the  ballot  as  valid  if  the  other 
two  votes  were  valid. 

The  number  of  void  ballots  has  in  the  past  been  attri- 
buted to  the  large  number  of  first  quarter  students;  however, 
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of  the  148  void  ballots,  5  failed  to  identify  their  voter 
category,  79  were  students,  40  were  alumni,  23  were  faculty, 
and  1  was  a  curricular  officer,  thus  37$  of  all  void  ballots 
were  from  the  non-student  population  and  could  not  be  attri- 
buted to  first  quarter  students. 
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IV.   STATISTICAL  ANALYSIS 

A.   TRANSFERRING  DATA  TO  COMPUTER  TAPE 

After  the  above  validation  process  was  completed,  the 
information  from  each  ballot  was  transferred  to  punched 
cards.   These  data  cards  were  then  processed  by  a  COBOL 
computer  program  called  "TRANSFER"3  which: 

1.  Checked  for  key  punch  errors. 

2.  Checked  for  a  population  of  at  least  five  teachers. 

3.  Gave  a  printed  output  of  all  ballots  which  contained 
errors . 

4 .  Transferred  the  data  from  ballots  which  contained  no 
errors  to  a  magnetic  computer  tape. 

The  techniques  used  by  "TRANSFER"  to  check  for  errors  was 
based  on  the  four  digit  identification  number  assigned  to 
each  teacher  on  the  ballot.   The  first  three  digits  of  each 
identification  number  assigned  to  each  teacher  on  the  ballot 
formed  a  vector,  N,  which  when  multiplied  by  a  fixed  weighing 
vector,  S,  formed  an  inner  product.   The  last  digit  of  this 
inner  product  formed  the  fourth  digit  of  the  identification 
number. 

For  example,  take  a  teacher  with  an  identification  number 
of  2934.  The  digits  293  identify  the  teacher,  while  the  last 
digit  "4"  is  the  result  of  the  last  digit  in  the  inner  product 

3 
(293)   5    =6+  45  +3=   54 
1 


JA  listing  of  "TRANSFER"  is  included  in  Appendix  B. 


14 


Thus  each  number  can  be  checked  for  correctness  using  an 
error  detection  system  where  the  inner  product  is  computed  and 
compared  against  the  fourth  digit  of  the  identification  number. 
Any  number  which  was  typed  in  error,  or  any  nomination  which 
the  voter  may  have  copied  incorrectly  from  the  ballot  would 
be  detected.   Only  after  each  number  on  each  ballot  was 
checked  would  that  ballot  be  transferred  to  the  magnetic  tape. 
Anytime  a  number  was  in  error  a  message  would  be  printed 
giving  the  ballot  number  and  the  cause  for  the  rejection. 
Corrections  would  be  made  to  the  appropriate  data  cards  and 
"TRANSFER"  would  be  run  again  until  all  valid  ballots  were 
recorded  on  the  magnetic  tape. 

B.   POPULATION  CHARACTERISTICS 

With  all  valid  ballots  recorded  on  tape  it  was  possible 

to  abstract  data  from  this  tape  which  would  give  a  breakdown 

of  the  characteristics  of  the  voting  population.   One  of  the 

major  goals  of  this  years  committee  was  to  increase  voter 

response,  to  the  maximum  possible  extent.   The  percentage 

of  response  was  determined  for  each  voter  category  for  both 

this  year  1972  and  last  year  1971.   Table  I.  below  lists  the 

breakdown  of  this  years  ballots. 

Table  I.   Ballot  Breakdown 

%   Increase 

Voter  Category   No. Eligible   No.  Valid     %   Valid  Over  Pre- 

Voters       Ballots   From  Eligible  vious  Yr . 

Student            1700         702         41.3  (12.8) 

Alumni             580         350         61.7  l2*  •  8 

Faculty            308         106         34.4  0.3 

Curricular  Officer   16           5         31.3  0.0 

Alumni  &  Students   2280        1052         46.1  (6.4) 

( )  Indicate  a  decrease 
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The  last  column  compares  the  difference  in  the  percent  of 
valid  ballots  returned  from  the  eligible  population  for  this 
year  and  last.   The  table  shows  that  there  was  no  change  in 
the  percentage  of  curricular  officers  voting,  while  the 
percentage  of  students  voting  dropped,  and  the  percentage  of 
alumni  and  faculty  voting  increased. 

C.   CLOSER  OBSERVATIONS 

Further  information  concerning  the  voter  population  is 
contained  in  the  following  set  of  tables.   Table  II  presents 
a  breakdown  of  faculty  voters  by  curricular  department  and 
academic  rank.   The  columns  indicate  the  different  ranks  and 
rows  indicate  academic  department.   By  scanning  the  Jth 
column  and  Ith  row,  a  determination  of  the  number  of  valid 
ballots  from  faculty  of  I  department  and  of  J  rank  can  be 

determined . 

Tables  III,  IV,  and  V  give  a  breakdown  of  military  voters 
by  Branch  of  Service,  Rank,  and  Voter  Category.   Table  V 
also  includes  civilian  students  and  alumnus  which  attended 
the  defense  management  school.   The  21  in  this  column  represents 
'5  civilian  students  and  16  civilians.   The  students  votes  are 
included  in  the  percentage  of  student  votes  for  that  curricular 
area.   In  each  table  the  Ith  row  gives  the  curricular  area  and 
Jth  column  gives  either  the  Branch  of  Service,  Rank,  or  Voter 
Category. 


16 


TABLE    II.    FACULTY 


Rank 
Department 

u 
o 
-p 

O 

M 

•p 

CO 

C 

M 

Assistant 
Professor 

Associate 
Professor 

M 

o 

CO 
CO 
CD 
Cm 
O 

M 

Total 
Voted 

Number 
Enrolled 

Aeronautics 

- 

4 

5 

4 

13 

22 

Aviation  Safety 

2 

- 

1 

- 

3 

6 

Business  Administra- 
tion &  Economics 

1 

2 

1 

2 

6 

31 

Electronic 
Engineering 

- 

2 

3 

6 

11 

46 

Government 
&  Humanities 

3 

- 

1 

1 

5 

12 

Material  Science 
&  Chemistry 

- 

- 

2 

1 

3 

12 

Math 

2 

2 

2 

2 

8 

41 

Mechanical 
Engineering 

1 

1 

1 

3 

6 

13 

Meteorology 

1 

5 

- 

1 

7 

13 

Oceanography 

1 

2 

1 

2 

6 

15 

Operations 
Analysis 

3 

3 

7 

2 

15 

46 

Physics 

- 

3 

2 

7 

12 

30 

Navy  Management 
Systems  Center 

2 

3 

3 

3 

11 

21 

Totals 

16 

27 

29 

34 

106 

308 
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TABLE  III.   BRANCH  OF  SERVICE 


CURRICULAR 
AREA 

NAVY 

ARMY 

MARINE 

COAST 
GUARD 

AIR 
FORCE 

FOREIGN 

30 

Operations 
Analysis 

129 

24 

6 

0 

0 

6 

31 

Aeronautical 
Engineering 

62 

0 

0 

0 

0 

0 

32 

Electronics  & 
Communication 

91 

0 

0 

0 

0 

1 

33 

Ordnance 

46 

6 

0 

0 

0 

1 

34 

Naval 
Engineering 

49 

0 

0 

0 

0 

o 

3 

35 

Environmental 
Science 

93 

0 

0 

1 

0 

3 

36 

Management  & 
Computer  Science 

250 

0 

11 

J 

0 

1 

37 

Engineering 
Science 

22 

0 

0 

0 

0 

1 

q  O 

Baccalaureate 

164 

0 

0 

0 

0 

0 

39 

Defense 

Management 

16 

9 

7 

0 

0 

7 

TOTALS 

921 

39 

.24 

4 

0 

23 

18 


TABLE    IV.       RANK 


CURRICULAR 
AREA 

01 

02 

03 

04 

05 

06 

30 

Operations 
Analysis 

10 

7 

90 

52 

5 

1 

31 

Aeronautical 
Engineering 

12 

4 

29  ■ 

13 

4 

0 

32 

Electronics  & 

Communication 

15 

3 

52 

33 

1 

3 

33 

Ordnance 

9 

3 

21 

17 

2 

1 

3^ 

Naval 
Engineering 

9 

3 

22 

16 

0 

2 

35 

Environmental 
Science 

18 

'  .  3 

42 

30 

4 

0 

36 

Management  & 
Computer  Science 

38 

7 

67 

109 

42 

2 

37 

Engineering 
Science 

0 

4 

12 

6 

0 

1 

38 

Baccalaureate 

32 

1 

43 

54 

33 

0 

39 

Defense 

Management 

2 

1 

8 

6 

14 

8 

TOTALS 

147 

36 

386 

336 

105 

18 

19 


TABLE  V.   VOTER  CATEGORY 


CURRICULAR 
AREA 

STUDENTS 

ALUMNI 

CURRIC- 
ULAR 
OFFICERS 

Enrollment 

Votes 

Percentage 

30 

Operations 

Analysis 

276 

139 

50.4 

26 

2 

31 

Aeronautical 
Engineering 

131 

47 

35.9 

15 

0 

32 

Electronics  & 

Communication 

186 

86 

46.3 

21 

0 

33 

Ordnance 

145 

41 

28.3 

12 

1 

34 

Naval 
Engineering 

92 

39 

42.4 

13 

1 

35 

Environmental 
Science 

128 

70 

55.6 

27 

0 

36 

Management  & 
Computer  Scien< 

339 

140 

41.0 

125 

1 

37 

Engineering 
Science 

76 

21 

27.6 

2 

0 

38 

Baccalaureate 

295 

98 

33.2 

65 

0 

39 

Defense 
Management 

32 

21 

65.6 

51 

0 

TOTALS 

1700 

702 

41.3 

357 

5 
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D.   DISTRIBUTION  OF  M± 

A  second  COBOL  computer  program  called  "PR OF SORT"   was 
run.   Its  purpose  was  to  reorganize  the  data  from  "TRANSFER" 
into  records  for  each  professor  which  is  identified  on  each 
ballot.   This  new  record-file  is  organized  by  ascending 
professor  number.   M.  is  defined  as  the  number  of  eligible 
faculty  members  known  by  the  ith  voter. 

Table  VI  presents  a  frequency  table  of  M^.   The  mean 
number  of  faculty  members  known  by  the  voters  was  17.7  and 
the  standard  deviation  was  11.6. 

Table  VI.   FREQUENCY  TABLE  OF  M± 


CELL 

FREQUENCY 

5-  9 

204 

10-14 

321 

15-19 

246 

20-24 

166 

25-29 

124 

30-34 

47 

35-39 

17 

40-44 

10 

45-49 

6 

50-5^ 

4 

55-59 

1 

60-64 

2 

65-69 

2 

70-74 

1 

75-79 

1 

80-84 

0 

85-89 

0 

90-94 

1 

V  listing  of  "PROFSORT"  is  included  in  Appendix  B, 
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E.   DISTRIBUTION  OF  NR 

A  third  COBOL  computer  program  called  "SCORSORT" -*  used 
the  sorted  data  produced  by  "PROFSORT"  as  input.   The 
"SCORSORT"  program  determined  the  distribution  of  NK,  the 
number  of  voters  who  knew  the  Kth  professor.   Table  VII  is  a 
frequency  table  of  Ny  and  figure  1  presents  a  histogram  of 
N„.   The  mean  number  of  voters  who  knew  teacher  K  was  70.5 
with  a  standard  deviation  of  43.4.   An  interesting  fact 
shown  by  the  frequency  table  of  NR  is  that  one  professor 
was  known  by  274  voters. 


Table  VII.   FREQUENCY  TABLE  OF  N„ 

ft 


CELL 

FREQUENCY 

1-  2  4 

19 

26-  50 

75 

51-  75 

99 

76-100 

40 

101-125 

33 

126-150 

16 

151-175 

6 

176-200 

2 

201-225 

0 

226-250 

1 

251-275 

1 

5 


A  listing  of  "SCORSORT"  is  included  in  Appendix  B 
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Figure  1.   HISTOGRAM  OF  NT^ 

A. 

Another  important  result  determined  by  "SCORSORT"  was 
the  performance  of  each  teacher,  T,,.   A  printout  of  the  Kth 
teacher's  score,  S„ ,    is  given.   S„  is  determined  in  "SCORSORT" 
as  follows: 

X,  v   =   Total  number  of  first  place  votes  for  T^.. 


'IK 


K 


XpK  =  Total  number  of  second  place  votes  for  Tj,. 
X,~  =  Total  number  of  third  place  votes  for  Tj,. 

X-,v>  X0„,  X~„  were  each  divided  by  N^,  the  number  of 

±!\  dK  _ji\  .       1\ 

persons  who  identified  T„  in  Part  C  of  the  ballot,  yielding 

is. 

a  vector  Vy. 

IV 
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VK  was  multiplied  by  a  weighting  vector  W,  where 
W  =  (4,2,1),  and  the  product  was  the  score,  S„,  for  teacher  K 

'ZK   =   (X1K  *  W)  +  (X2K  '  ^  +  (X3K  '  W) 

SK   NK 

Table  VIII  presents  a  summary  of  the  "SCORSORT"  printout 
showing  K,  SK,  N„,  ZK,  X1K.,  Xp„,  and  X~K  respectively. 


F.   DOMINANCE 

The  fourth  COBOL  computer  program  called  "DOMINANCE" 
used  the  results  generated  by  "SCORSORT"  for  input  data.   This 
data  included 

XjK   =  The  number  of  Ith  place  votes  received  by  teacher  K. 

NK   =  Number  of  voters  who  knew  T^. 

V"IK  =  XT„/NK  =  Fraction  of  Ith  place  votes  awarded  TK  by 

the  population  of  voters  that  knew  him. 

The  purpose  of  this  program  was  to  reduce  the  number  of 
eligible  recipients  by  two  methods,  (1)  absolute  dominance  and 
(2)  complete  dominance. 

1 .   Background 

If  S„,  the  score  of  teacher  K  is  represented  by 

3 
Sv   =  l     \J^*VTV  where  W  =  (W-.  ,  W0 ,  W0 )  is  a 

IS.  y_-,        1       ±J\  1  d  J 

weighing  vector  such  that 

w2  >  w2  >  W,  >  0.  (1) 


A  listing  of  "DOMINANCE"  is  included  in  Appendix  B 
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TABLE  VIII.   SCORSORT  SUMMARY 


K 

SK 

NK 

ZK 

X1K 

X2K 

X3K 

1 

1.92157 

51 

98 

17 

11 

8 

2 

1.77586 

58 

103 

23 

3 

5 

3 

1.75862 

29 

51 

9 

6 

3 

4 

1.57353 

68 

107 

20 

11 

5 

5 

1.50000 

68 

102 

17 

13 

8 

6 

1.47222 

108 

159 

30 

13 

13 

7 

1.43478 

69 

99 

19 

10 

3 

8 

1.35238 

105 

142 

24 

16 

14 

9 

1.30994 

171 

224 

36 

31 

18 

10 

1.26446 

121 

153 

24 

23 

11 

11 

1.24234 

74 

92 

14 

12 

12 

12 

1.24234 

74 

92 

21 

2 

4 

13 

1.17073 

41 

48 

7 

7 

6 

14 

1.13043 

23 

26 

5 

2 

2 

15 

1.11321 

106 

118 

20 

15 

8 

16 

1.10714 

56 

62 

12 

6 

2 

17 

1.10606 

66 

73 

12 

10 

5 

18 

1.08824 

102 

111 

18 

15 

9 

19 

1.05882 

34  • 

36 

6 

4 

4 

20 

1.05761 

52 

55 

9 

6 

7 

21 

1.05128 

78 

82 

17 

6 

2 

22 

1.00000 

83 

■  83 

14 

9 

9 

23 

1.00000 

27 

27 

5 

3 

1 

24 

0.94737 

57 

54 

7 

12 

2 

25 

0.90805 

87 

79 

10 

16 

7 

26 

0.90196 

51 

46 

10 

1 

4 

27 

0.89655 

116 

104 

19 

10 

8 

28 

0.89535 

86 

77 

11 

13 

7 

29 

0.89130 

46 

41 

7 

5 

3 

30 

0.88889 

45 

40 

.6 

5 

6 

31 

0.88722 

133 

118 

22 

10 

10 

32 

0.87342 

79 

69 

15 

3 

3 

33 

0.86364 

66 

57 

10 

4 

9 

34 

0.84946 

93 

79 

12 

12 

7 

35 

0.83077 

65 

54 

10 

5 

4 

36 

0.82553 

235 

194 

32 

21 

24 

37 

0.81731 

104 

85 

15 

8 

9 

38 

0.81553 

103 

84 

12 

12 

12 

39 

0.81132 

53 

43 

7 

6 

3 

40 

0.80000 

55 

44 

6 

6 

8 

41 

0.76860 

121 

93 

12 

17 

11 

42 

0.75781 

128 

97 

16 

13 

7 

43 

0.75000 

28 

21 

3 

4 

1 

44 

0.74138 

116 

86 

16 

8 

6 

25 


TABLE 

VIII. 

SCORSORT 

SUMMARY 

(Continue 

sd) 

K 

ST, 

N„ 

'  z„ 

X 

K 

K 

K 

IK 

2K 

3K 

45 

0.73333 

30 

22 

4 

2 

2 

46 

0.72973 

74 

54 

5 

11 

12 

47 

0.71233 

73 

52 

9 

5 

6 

48 

0.63380 

71 

45 

10 

1 

3 

49 

0.61165 

103 

63 

10 

9 

5 

50 

0.60465 

129 

78 

9 

17 

8 

51 

0.59302 

86 

51 

6 

12 

3 

52 

0.58974 

39 

23 

4 

2 

3 

53 

0.58108 

74 

43 

5 

10 

3 

54 

0.57647 

85 

49 

8 

4 

9 

55 

0.57377 

61 

35 

5 

6 

3 

56 

0.56944 

72 

41 

5 

8 

5 

57 

0.56140 

57 

32 

3 

8 

4 

58 

0.56000 

75 

42 

6 

7 

4 

59 

0.55932 

59 

33 

5 

5 

3 

60 

0.55263 

38 

21 

4 

1 

3 

61 

0.55245 

143 

79 

11 

12 

11 

62 

0.54545 

22 

12 

2 

1 

2 

63 

0.54015 

137 

74 

11 

11 

8 

64 

0.53846 

26 

14 

2 

0 

6 

65 

0.53030 

66 

35 

5 

6 

3 

66 

0.52252 

111 

58 

6 

12 

10 

67 

0.51923 

52 

27 

4 

3 

5 

68 

0.51282 

117 

60 

8 

8 

12 

69 

0.51220 

82 

42 

8 

4 

2 

70 

0.50000 

164 

82 

12 

11 

12 

71 

0.50000 

24 

12 

0 

5 

2 

72 

0.49333 

75 

37 

3 

9 

7 

73 

0.49180 

61 

30 

4 

6 

2 

74 

0.48649 

74 

36 

6 

3 

6 

75 

0.47423 

97 

46 

8 

4 

6 

76 

0.47222 

36 

17 

1 

4 

5 

77 

0.46575 

73 

34 

5 

5 

4 

78 

0.46000 

50 

23 

4 

1 

5 

79 

0.45652 

92 

42 

7 

4 

6 

80 

0.45455 

121 

55 

4 

12 

15 

81 

0.45455 

44 

20 

4 

2 

0 

82 

0.45378 

119 

54 

6 

11 

8 

83 

0.44828 

58 

26 

3 

6 

2 

84 

0.44615 

130 

58 

6 

11 

11 

85 

0.44262 

61 

27 

4 

3 

5 

86 

0.42857 

21 

9 

1 

2 

1 

87 

0.42553 

94 

40 

6 

4 

8 

88 

0.42424 

66 

28 

4 

5 

2 

26 


TABLE 

VIII. 

SCORSORT 

SUMMARY 

(Continued' 

) 

K 

SK 

NK 

ZK 

X1K 

X2K 

1 
X3K 

89 

0.42169 

166 

70 

12 

5 

12 

90 

0.41975 

81 

34 

4 

7 

4 

91 

0.41667 

60 

25 

3 

3 

7 

92 

0.41379 

87 

36 

5 

6 

4 

93 

0.41071 

56 

23 

4 

3 

1 

94 

0.40476 

42 

17 

2 

4 

1 

95 

0.40299 

67 

27 

4 

4 

3 

96 

0.40000 

65 

26 

5 

2 

2 

97 

0.39726 

73 

29 

4 

4 

5 

98 

0.39216 

51 

20 

1 

6 

4 

99 

0.38562 

153 

59 

7 

10 

11 

100 

O.38298 

47 

18 

3 

2 

2 

101 

0.37931 

58 

22 

3 

3 

4 

102 

0.37778 

90 

34 

1 

10 

10 

103 

0.37705 

61 

23 

3 

3 

5 

104 

0.37333 

75 

28 

5 

3 

2 

105 

0.37255 

102 

38 

7 

3 

4 

106 

0.36667 

30 

11 

2 

1 

1 

107 

O.36585 

41 

15 

1 

4 

3 

108 

0.36207 

58 

21 

1 

.   6 

5 

109 

0.35556 

90 

32 

4 

5 

6 

110 

0.35294 

17 

6 

1 

0 

2 

111 

0.34211 

38 

13 

3 

0 

1 

112 

0.33594 

128 

43 

7 

6 

3 

113 

0.33333 

51 

17 

1 

5 

3 

114 

0.32632 

95 

31 

4 

6 

3 

115 

0.32500 

40 

13 

1 

4 

1 

116 

0.32468 

77 

25 

2 

6 

5 

117 

0.31579 

19 

6 

0 

3 

0 

118 

0.31373 

51 

16 

2 

3 

2 

119 

0.31250 

48 

15 

2 

2 

3 

120 

0.30769 

39 

12 

2 

1 

2 

121 

0.30769 

39 

12 

2 

2 

0 

122 

0.30645 

62 

19 

2 

3 

5 

123 

0.30435 

115 

35 

7 

2 

3 

124 

0.29921 

127 

38 

4 

7 

8 

125 

0.29167 

24 

7 

1 

0 

3 

126 

0.29141 

326 

95 

14 

13 

13 

127 

0.28947 

38 

11 

1 

3 

1 

128 

0.28571 

28 

8 

1 

2 

0 

129 

0.28125 

160 

45 

1 

12 

17 

130 

0.28090 

89 

25 

4 

2 

5 

131 

0.27660 

4  7 

13 

2 

2 

1 

132 

0.27586 

29 

8 

1 

1 

2 

27 


TABLE 

VIII. 

SCORSORT 

SUMMARY 

(Continue 

>d) 

K 

SK 

NK 

ZK 

X1K 

X2K 

X3K 

133 

0.27273 

44 

12 

1 

2 

4 

13^ 

0.27027 

37 

10 

1 

2 

2 

135 

0.26923 

52 

14 

3 

0 

2 

136 

0.26667 

60 

16 

1 

3 

6 

137 

0.26563 

64 

17 

2 

4 

1 

138 

0.25641 

117 

30 

5 

3 

4 

139 

0.25385 

130 

33 

5  . 

5 

3 

140 

0.25352 

71 

18- 

3 

2 

6 

141 

0.25287 

87 

22 

3 

2 

6 

1M2 

0.25225 

111 

28 

5 

3 

2 

143 

0.25000 

80 

20 

3 

2 

4 

144 

0.25000 

36 

9 

1 

1 

3 

145 

0.24528 

53 

13 

1 

4 

1 

146 

0.24444 

45 

11 

1 

2 

3 

147 

0.24138 

145 

35 

3 

8 

7 

148 

0.23944 

71 

17 

1 

5 

3 

149 

0.23894 

113 

27 

3 

2 

11 

150 

0.23711 

97 

23 

3 

4 

3 

151 

0.23404 

47 

11 

0 

3 

5 

152 

0.22917 

96 

22 

2 

4 

6 

153 

0.22807 

57 

13 

2 

1 

3 

154 

0.22535 

71 

16 

3 

2 

0 

155 

0.22222 

45 

10 

1 

3 

0 

156 

0.22222 

45 

10 

0 

2 

6 

157 

0.22059 

68 

15 

2 

3 

1 

158 

0.21875 

64 

14 

1 

4 

2 

159 

0.21667 

60 

13 

2 

2 

1 

160 

0.21311 

61 

13 

1 

3 

3 

161 

0.20690 

29 

6 

0 

2 

2 

162 

0.20000 

45 

9 

2 

0 

1 

163 

0.19512 

123 

24 

4 

2 

4 

164 

0.19355 

93 

18 

1 

4 

6 

165 

0.19048 

42 

8 

0 

3 

2 

166 

0.18033 

61 

11 

1 

2 

3 

167 

0.17778 

45 

8 

0 

4 

0 

168 

0.17500 

40 

7 

1 

1 

1 

169 

0.17355 

121 

21 

3 

4 

1 

170 

0.17241 

58 

10 

2 

1 

0 

171 

0.16867 

83 

14 

2 

2 

2 

172 

0.16774 

155 

26 

2 

5 

8 

173 

0.16667 

54 

9 

1 

2 

1 

174 

0.16484 

91 

15 

2 

3 

1 

175 

0.16129 

62 

10 

1 

2 

2 

176 

0.15625 

32 

5 

0 

1 

3 

28 


TABLE 

VIII. 

SCORSORT 

SUMMARY 

(Continue 

>d) 

K 

SK 

NK 

ZK 

X1K 

X2K 

X3K 

177 

0.15254 

59 

9 

1 

2 

1 

178 

0.15217 

46 

7 

1 

1 

1 

179 

0.14474 

76 

11 

1 

3 

1 

180 

0.14362 

188 

27 

4 

3 

5 

181 

0.14286 

14 

2 

0 

1 

0 

182 

0.13725 

51 

7 

0 

2 

3 

183 

0.12963 

54 

7 

1 

1 

1 

184 

0.12500 

64 

8 

1 

2 

0 

185 

0.12088 

91 

11 

0 

4 

3 

186 

0.12000 

75 

9 

1 

2 

1 

187 

0.11905 

42 

5 

0 

1 

3 

188 

0.11765 

17 

2 

0 

1 

0 

189 

0.11667 

60 

7 

1 

1 

1 

190 

0.11570 

121 

14 

1 

3 

4 

191 

0.11530 

26 

.  3 

0 

1 

1 

192 

0.115H 

139 

16 

1 

3 

6 

193' 

0.11111 

63 

7 

0 

3 

1 

194 

0.11111 

45 

5 

0 

2 

1 

195 

0.10909 

110 

12 

1 

3 

2 

196 

0.10811 

74 

8 

0 

3 

2 

197 

0.10280 

107 

11 

0 

3 

5 

198 

0.10169 

59 

6 

0 

2 

2 

199 

0.10169 

59 

6 

1 

0 

2 

200 

0.10000 

70 

7 

1 

1 

1 

201 

0.10000 

40 

4 

1 

0 

0 

202 

0.09804 

102 

10 

1 

2 

2 

203 

0.09756 

41 

4 

0 

2 

0 

204 

0.09459 

74 

7 

1 

0 

3 

205 

0.09434 

53 

5 

1 

0 

1 

206 

0.09346 

107 

10 

1 

2 

2 

207 

0.09302 

43 

4 

1 

0 

0 

208 

0.09091 

77 

7 

1 

1 

1 

209 

0.09091 

55 

5 

1 

0 

1 

210 

0.09091 

33 

3 

0 

1 

1 

211 

0.09091 

33 

3 

0 

1 

1 

212 

0.08889 

90 

8 

0 

3 

2 

213 

0.08725 

149 

13 

1 

3 

3 

214 

0.08571 

70 

6 

0 

2 

2 

215 

0.08511 

47 

4 

1 

0 

0 

216 

0.08475 

59 

5 

0 

2 

1 

217 

0.08333 

12 

1 

0 

0 

1 

218 

0.08235 

85 

7 

1 

0 

3 

219 

0.07692 

39 

3 

0 

1 

1 

220 

0.07692 

26 

2 

0 

1 

0 

29 


TABLE 

VIII. 

SCORSORT 

•SUMMARY 

(Cont 

inued) 

K 

SK 

NK 

ZK 

X1K 

X2K 

1 
X3K 

221 

0.07576 

66 

5 

0 

2 

1 

222 

0.07500 

80 

6 

1 

1 

0 

223 

0.07353 

68 

5 

1 

0 

1 

224 

0.07333 

150 

11 

1 

3 

1 

225 

0.06897 

58 

4 

0 

1 

2 

226 

0.06667 

30 

2 

0 

0 

2 

227 

0.06410 

78 

5 

0 

2 

1 

228 

0.06250 

32 

2 

0 

1 

0 

229 

0.06250 

32 

2 

0 

0 

2 

230 

0.06000 

50 

3 

0 

1 

1 

231' 

0.05556 

108 

6 

1 

0 

2 

232 

0.05357 

56 

3 

0 

1 

1 

233 

0.05172 

58 

3 

0 

1 

1 

231* 

0.04762 

105 

5 

1 

0 

1 

235 

0.04545 

22 

1 

0 

0 

1 

236 

0.04444 

90 

4 

1 

0 

0 

237 

0.04324 

185 

8 

2 

0 

0 

238 

0.04317 

139 

6 

1 

1 

0 

239 

0.04167 

48 

2 

0 

0 

2 

240 

0.03704 

54 

2 

0 

■  1 

0 

241 

O.O3676 

136 

5 

1 

0 

1 

242 

O.O3636 

55 

2 

0 

1 

0 

243 

0.03614 

83 

3 

0 

1 

1 

244 

0.03604 

111 

4 

0 

2 

0 

245 

0.03390 

59 

2 

0 

1 

0 

246 

0.03279 

61 

2 

0 

0 

2 

247 

0.03261 

92 

3 

0 

1 

1 

248 

0.02778 

36 

1 

0 

0 

1 

249 

0.02703 

74 

2 

0 

0 

2 

250 

0.02703 

37 

1 

0 

0 

1 

251 

0.02632 

38 

1 

0 

0 

1 

252 

0.02564 

39 

1 

0 

0 

1 

253 

0.02326 

43 

1 

0 

0 

1 

254 

0.01818 

55 

1 

0 

0 

1 

255 

0.01786 

56 

1 

0 

0 

1 

256 

0.01449 

69 

1 

0 

0 

1 

257 

0.00990 

101 

1 

0 

0 

1 

258 

0.00926 

108 

1 

0 

0 

1 

259 

0.00714 

140 

1 

0 

0 

1 

260 

0.00000 

100 

0 

0 

0 

0 

261 

0.00000 

91 

0 

■  0 

0 

0 

262 

0.00000 

89 

0 

0 

0 

0 

263 

0.00000 

85 

0 

0 

0 

0 

264 

0.00000 

71 

0 

0 

0 

0 
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TABLE 

VIII. 

SCORSORT 

SUMMARY 

(Continued) 

K 

S„ 

NT, 

z„ 

K 

K 

K 

IK 

2K 

3K 

265 

0.00000 

67 

0 

0 

0 

0 

266 

0.00000 

66 

0 

0 

0 

0 

267 

0.00000 

61 

0 

0 

0 

0 

268 

0.00000 

58 

0 

0 

0 

0 

269 

0.00000 

57 

0 

0 

0 

0 

270 

0.00000 

54 

0 

0 

0 

0 

271 

0.00000 

50 

0 

0 

0 

0 

272 

0.00000 

49 

0 

0  ' 

0 

0 

273 

0.00000 

39 

0 

0 

0 

0 

274 

0.00000' 

38 

0 

0 

0 

0 

275 

0.00000 

38 

0 

0 

0 

0 

276 

0.00000 

34 

0 

0 

0 

0 

277 

0.00000 

34 

0 

0 

0 

0 

278 

0.00000 

32 

0 

0 

0 

0 

279 

0.00000 

31 

0 

0 

0 

0 

280 

0.00000 

29 

0 

0 

0 

0 

281 

0.00000 

27 

0 

0 

0 

0 

282 

0.00000 

26 

0 

0 

0 

0 

283 

0. 00000 

26 

0 

0 

0 

0 

284 

0.00000 

24 

0 

0 

0 

0 

285 

0.00000 

23 

0 

0 

0 

0 

286 

0.00000 

22 

.0 

0 

0 

0 

287 

0.00000 

22 

0 

0 

0 

0 

288 

0.00000 

22 

0 

0 

0 

0 

289 

0.00000 

20 

0 

0 

0 

0 

290 

0.00000 

14 

0 

0 

0 

0 

291 

0.00000 

3 

0 

0 

0 

0 
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Expression  (1)  states  that  a  first  place  vote  should  be 
weighted  higher  than  a  second  place  vote,  which  in  turn  should 
be  weighted  higher  than  a  third  place  vote,  and  that  all 
weights  be  greater  than  zero. 

A  second  set  of  restrictions  on  the  weights  logically 
would  be  that  no  two  weights  be  the  same  or  that 

W2  /  W]_  <   1  (2) 

VJ3  /  W2  <   1  (3) 

therefore  from  (1),  (2),  and  (3)  we  have 

o  <  w2/v/1  <  1 

0  <  W-VW2  <  1 

Now  letting  (a.,,b-,. )  and  (ap,b„)  define  a  preferential  region 
interior  to  the  unit  square  then 


0  <  al  -  W2/Wl  -  bl  <  1 


0  <  a2  <  W,/W2  <  b2  <  1 


The  values 

a1  =  a2  =  1/3 
b1   =   b2   =   2/3 

were  used  as  acceptable  parameters  based  on  a  determination 
of  the  smallest  and  largest  ratios  acceptable  for  the  three 
weights. 
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2 .  Absolute  Dominance 

If  K  and  K'  denote  any  two  teachers,  S^  and  SK,  are 
their  respective  scores  from  "SCORSORT"  then  it  is  desired 
to  find  all  values  of  W  such  that 

S^  >  S„, .   For  all  K  *   K' 

therefore  by  substitution, 

Wl  V1K  +  W2  V2K  +  W3V3K  2-  Wl  V1K'  +  W2  V2K-  +  W3  V3K'    W 
or 

Wl  (V1K  -  V1K'>  +  W2  (V2K  "  V2K>>  +  W3(V3K  "  V3K- )  i  °   <5> 

Then  teacher  K  is  absolutely  dominant  over  teacher  K' 

when  V, „  -  Vn„.  >  0,   I  =  1,  2,  3,  for  then  S77  >  S„,  and 
IK     IK'     '        '   '  *"  K     K1 

teacher  K'  can  be  eliminated  from  the  competition. 

3 .  Complete  Dominance 

The  second  form  of  dominance,  complete  dominance 
eliminates  all  teachers  who  in  order  to  win  must  have  a 
weighting  system  that  violates  W,  >  W?  >  W_ . 

From  (5) 


W  W 

wj  (V1K  "  V1K<>  +  (V2K  "  V2K'>  +  ^    ^K  "  V3K<  >  ^  °    (6) 


or 


h  -(V1K  '  V1K'}  Wl    (V2K  -  W 

w2  -   (v3K  -  v3K,)  w2  "  (v3K  -  V  ,) 
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The  dominance  relationship  is  determined  by  W-.  ,  W? , 
and  Wo  since  all  values  of  V,  K  and  V-.K,  are  known. 

Letting  Y  =  W  /  w~2 ,   X  =  W],  /  w"2   and  noting  that 
0  <_  Y  <_  1   and   X  >  1   then  letting 

A   =   (V1K  -  V1K.) 
B  "  "(V2K  '  VZY^ 

c  -   v3K  -  v3K, 


and  substituting  into  expression  (5)  we  have   Y 
which  is  the  slope  intercept  form  for  a  line. 


AX   B 
C    C 


X 


Figure  2.   DOMINANCE  PLOT 

Figure  2  is  a  plot  of  Y  vs  X  with  the  feasible  region 
shown  for  the  weights.   Teacher  K  is  completely  dominated  by 
teacher  K'  if  either 

1)  A/C  >  0   and  Y(l)  >  1        C  >  0 

2)  A/C  <  0   and   Y(l)  <  0        C  <  0 
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3)   C  =  0   and 

a)  -A  <  0   and   B/A  <  1 

b)  -A  =  0   and   -B   <  0 

*J .   Results 

Table  IX  presents  a  summary  of  the  dominance  tests. 
Tv'>  V,„,  V0„,  and  VOLr  are  defined  above,  AD  and  CD  are  results 
of  absolute  and  complete  dominance.   A  one  indicates  that  a 
teacher  is  dominated  and  a  zero  indicates  a  teacher  is  not 
dominated  and  has  not  been  eliminated. 

After  screening  for  absolute  dominance  only  4  teachers 
out  of  279  remained  in  contention,  and  the  complete  dominance 
reduced  this  number  to  two. 

G.   COMPARISONS 

7 

A  Fortran  program  called  "COMPARISON"   compares  the  scores 
of  the  Ith  teacher  against  that  of  the  Jth  teacher  with  the 
constraint  that  each  of  these  teachers  is  known  by  a  given 
voter.   The  study  compared  the  twenty  teachers  with  the  highest 
score  from  "SCCRSORT"  with  each  other. 

The  final  score  for  each  paired  comparison  was  based  only 
on  the  sub-population  of  voters  that  identified  both  teachers. 
The  teacher  ranked  first  in  "SCORSORT"  would  be  expected  to 
win  over  all  other  teachers,  and  the  teacher  ranked  last 
would  be  expected  to  lose  to  all  other.   If  the  first  teacher 


7 

'A  listing  of  COMPARISON"  is  included  in  Appendix  B. 
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TABLE    IX.       DOMINANCE   TEST   RESULTS 


T„ 

v\  „ 

V™ 

V 

AD 

CD 

K 

IK 

2K 

3K 

1 

0.333 

0.216 

0.157 

0 

0 

2 

0.397 

0.052 

0.086 

0 

0 

3 

0.310 

0.207 

0.103 

1 

1 

*1 

0.294 

0.162 

0.074 

1 

1 

5 

0.250 

0.191 

0.118 

1 

1 

6 

0.278 

0.120 

0.120 

1 

1 

7 

0.275 

0.145 

0.043 

1 

1 

8 

0.229 

0.152 

0.133 

1 

1 

9 

0.211 

0.181 

0.105 

1 

1 

10 

0.198 

0.190 

0.091 

1 

1 

11 

0.189 

0.162 

0.162 

0 

1 

12 

0.284 

0.027 

0.054 

1 

1 

13 

0.171 

0.171 

0.146 

1 

1 

Ik 

0.217 

0.087 

0.087 

1 

JL. 

15 

0.189 

0.142 

0.075 

1 

l 

16 

0.214 

0.107 

0.036 

1 

l 

17 

0.182 

0.152 

0.076 

1 

l 

18 

0.176 

0.147 

0.088 

1 

l 

19 

0.176 

0.118 

0.118 

1 

l 

20 

0.173 

0.115 

0.135 

1 

l 

21 

0.218 

0.077 

0.026 

1 

l 

22 

0.169 

0.108 

0.108 

1 

l 

23 

0.185 

0.111 

0.037 

1 

l 

24 

0.123 

0.211 

0.035 

■  1 

l 

25 

0.115 

0.184 

0.080 

1 

l 

26 

0.196 

0.020 

0.078 

1 

l 

27 

0.164 

0.086 

O.O69 

1 

l 

28 

0.128 

0.151 

0.081 

1 

l 

29 

0.152 

0.109 

0.065 

1 

l 

30 

0.133 

0.111 

0.133 

1 

l 

31 

0.165 

0.075 

0.075 

1 

l 

32 

0.190 

0.  038 

0.038 

1 

l 

33 

0.152 

0.061 

0.136 

1 

l 

3^ 

0.129 

0.129 

0.075 

1 

l 

35 

0.154 

0.077 

0.062 

1 

l 

36 

0.136 

0.089 

0.102 

1 

l 

37 

0.144 

0.077 

0.087 

1 

l 

38 

0.117 

0.117 

0.117 

1 

l 

39 

0.132 

0.113 

0.057 

1 

l 

4o 

0.109 

0.109 

0.145 

1 

l 

4l 

0.099 

0.140 

0.091 

1 

l 

42 

0.125 

0.102 

0.055 

1 

l 

43 

0.107 

0.143 

0.036 

1 

l 

44 

0.138 

O.O69 

0.052 

1 

l 

^5 

0.133 

O.O67 

0.067 

1 

l 

46 

0.068 

0.149 

0.162 

0 

l 

hi 

0.123 

0.068 

0.082 

1 

l 

48 

0.141 

0.014 

0.042 

1 

l 

49 

0.097 

0.087 

0.049 

1 

l 

50 

0.070 

0.132 

0.062 

1 

l 
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were  to  lose  in  any  of  the  tests  then  significant  argument 
might  be  made  for  giving  the  award  to  another  of  the  high 
ranking  teachers. 

The  results  of  the  paired  comparison  analysis  for  the  top 
twenty  teachers  were  computed;  however,  since  the  teachers 
who  were  found  to  be  dominant,  violated  the  constraint  that 
they  have  some  voters  in  common,  the  results  did  not  enter 
into  the  final  selection  process. 
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V.   THE  SELECTION 

Once  all  the  results  were  obtained,  a  set  of  statistics 
was  prepared  and  presented  to  this  years  selection  committee. 
This  presentation  included: 

1.  Statistics  on  the  voting  population 

2.  Printed  results  of  all  computer  programs 

3.  Results  of  dominance  tests 

4.  An  abstract  of  comments  from  all  ballots  in  which 
the  individuals  passing  the  dominance  tests  had  been 
identified. 

Following  the  above  presentation,  the  committee  voted  unani- 
mously for  teacher  number  one. 

The  winners  name  was  forwarded  to  the  Academic  Dean  and 
Superintendent  and  will  be  made  public  at  the  June  graduation 
ceremonies . 

The  names  of  individual  teachers  concerned  were  unknown 
to  the  selection  committee  throughout  the  process.   At  the 
time  the  above  ballot  results  were  revealed,  the  only  name 
announced  was  that  of  the  winner,  which  will  continue  to 
remain  secret  until  announced  at  the  graduation  ceremonies. 
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VI.   RECOMMENDATIONS 

As  was  noted  in  table  I,  alumni  and  faculty  show  an 
increase  in  the  percentage  of  voters  over  the  previous  years. 
Some  possible  causes  for  the  decrease  in  students  response 
might  be  attributed  to 

1.  The  timing  of  the  distribution  of  the  ballots  was  such 
that  the  voting  extended  over  an  exam  period. 

2.  The  long  response  time  given  to  students  may  have  caused 
students  to  put  off  responding,  thus,  causing  them  to 
forget  about  responding  altogether. 

3.  It  was  possible  this  year  due  to  a  special  letter  which 
was  attached  to  the  alumni  ballot  to  correct  ballots 
which  were  labeled  as  students,  but  definitely  from  an 
alumnus  to  be  corrected.   This  problem  of  alumni  still 
identifying  as  students  is  obviously  a  reoccurring 
problem  and  a  more  meaningful  statistic  would  be  a 
comparison  of  alumni  and  students  together.   However, 
this  figure  also  showed  a  decrease  in  response. 

Next  years  committee  should  consider  shortening  the  response 

time,  avoiding  exam  periods,  and  redesigning  Part  A  of  the 

ballot  so  as  to  eliminate  common  errors  made  in  voter  statistics 

A.   REVISION  OF  PART  A 

The  problem  of  ballots  with  no  voter  category  was  eliminated 
this  year  primarily  because  the  ballots  for  different  groups 
were  printed  at  different  times.   With  the  small  changes  which 
were  made  it  was  possible  in  many  cases  to  identify  voter 
category  even  if  it  were  left  blank.   However,  the  problems  of 
blank  voter  category  is  one  which  still  must  be  solved.   The 
possible  causes  listed  here  are: 
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1.  The  instructions  concerning  the  voter  category  were 
vague  and  misinterpreted. 

2.  Voter  did  not  want  to  take  time  to  fill  out  Part  A. 

3.  The  voter  did  not  want  to  be  identified. 

Of  the  above,  the  most  likely  explanation  concerns  the 
instruction  sheet.   The  reference  to  Part  A  was  given  in 
step  1.   The  instructions  given  in  Part  A  proved  to  be 
inadequate.   Major  mistakes  were 

1.  Student  /  Alumnus  /  Faculty  /  Curricular  Officer 
Section  —  circled  wrong  choice.   This  could  be 
eliminated  by  having  instructions  which  state: 

YOU  ARE  PRESENTLY  A  (CIRCLE  ONE) 

S   Student 

A   Alumnus 

F   Faculty  Member 

C  Cirricular  Officer 

2.  Rank  —  In  many  cases  this  was  circled  to  indicate 
branch  of  service.   (01  was  circled  because  it  was 
to  the  left  of  N  Navy).   This  accounts  for  the  large 
number  of  ensigns  which  were  recorded  as  having  voted. 
Instructions  such  as: 

(Military  only  circle  your  present  rank) 
01     02     03     Oh  05     06     07 

should  eliminate  this  problem  area. 

3.  A  common  problem  was  that  civilian  students  were 
confused  as  to  what  area  to  circle.   Most  of  them  used 
the  area  meant  for  faculty  because.it  was  labeled 
civilian.   A  possible  solution  would  be  relabeling  and 
adding  a  voter  category  of  civilian  under  branch  of 
service . 

Part  A  would  thus  look  like  this  if  all  my  suggestions 

were  incorporated: 

Al   -   (All)  You  are  presently  a  (Encircle  one) 
S   Student 
A   Alumnus 
F   Faculty  member 
C    Curricular  Officer 
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A2   -   (Military  Only)   Your  present  rank  is:   (Encircle  one) 
01     02     03     04     05     06     07 

A3   -  (All)   (Encircle  code  at  left) 

Students/  Alumni/  Curricular  Officers 
Branch  of  Service    Curricular  Area 


c 

Civilian 

30 

Ops  Analysis 

N 

Navy 

31 

Aero  Eng 

M 

Marine  Corps 

32 

Elec  &  Comm  Eng 

C 

Coast  Guard 

33 

Ordnance 

A 

Army 

34 

Naval.  Eng 

L 

Air  Force 

35 

Env  Sci 

F 

Foreign 

36 

Mange  &  Compt  Sci 

37 

Eng  Sci 

38 

Baccalaureate 

39 

Def  Management 

Facu 

Ity 

Position 

Department 

IR 

Instructor 

AE 

Aeronautics 

AT 

Assist  Prof 

AO 

Aviation  Safety 

AC 

Assoc  Prof 

MN 

Bus  Ad  &  Econ 

PR 

Professor 

EE 

Ele  Eng 

GH 

Govt  &  Human 

MC 

Mat  Sc  &  Chem 

MA 

Math 

ME 

Mech  Eng 

MR 

Meteorology 

OC 

Oceanography 

OA 

Ops  Analysis 

PH 

Physics 

NS 

Navy  Mange  Sys  Center 

B.   COMMITTEE  RECOMMENDATION  , 

This  years  committee  has  recommended  that  in  the  future 
alumni  from  the  selected  year  also  include  U.  S.  Marines, 
Coast  Guard,  Air  Force,  and  Foreign  Officer  graduates. 
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VII.   FURTHER  ANALYSIS 

With  three  years  of  data  to  work  with  some  questions 
concerning  the  ranking  of  teachers  could  be  examined. 

1.  Do  students  and  alumni  tend  to  rank  teachers  similarly? 

2.  Does  the  ranking  of  teachers  by  students  remain  fairly 
constant  from  year  to  year? 

These  questions  are  addressed  is  subsection  A. 

A.   CONCORDANCE  ESTIMATION 

o 

Using  Kendall's   coefficient  of  concordance,  the  degree 
of  resemblance  between  two  sets  of  data  can  be  determined. 
If  the  coefficient  is  close  to  one  the  two  data  sets  show 
similar  rankings.   The  further  the  coefficient  is  from  one 
and  the  closer  it  is  to  zero  the  less  the  two  sets  resemble 
each  other.   Thus,  this  test  can  be  used  to  determine  if  a 
teacher  which  is  ranked  high  by  student  voters  would  also  be 
ranked  high  by  alumni. 

Table  X  is  a  2  x  175  matrix  of  the  rankings  of  teachers 
which  were  known  by  at  least  10  voters  from  each  group.   The 
first  row  is  the  ranking  of  the  teachers  by  the  alumni  and 
the  second  row  represents  the  ranking  by  the  students. 

Kendall  defines  the  relationship  as 

12(S) 


W  = 


m2(n3-n)  -  12mT 


o 
Kendall,  M.  G.,  Rank  Correlation  Methods,  2d  e.,  p.  3-11, 
9*1-100,  Griffin,  1955. 
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where  W  is  the  coefficient  of  concordance,  m  is  the  number 

of  raters,  n  is  the  number  of  rankings,  S  is  the  total  sum 

n    - 
of  squares  of  actual  deviations,   T  =   .  £n(t.  -  t.),  and  t 

indicates  number  of  ties  of  length  i. 

A  computer  program  was  written  which  computed  all  values 

from  the  table.   Its  results  indicated  that 

12  (1368609) 
W  =  : — : : =   .7690 

((2)2((175)3  -  175)))  -  (12  *  2  *  3394) 

9 
The  significance  of  VI  may  be  tested  using  Fisher's   Z, 

letting  Z  =  1/2  log    ' "_/, —  =  .6013.   The  appropriate  degrees 

of  freedom  for  consulting  the  Z  table,  are 

V_   =   (n-1)  -  -  =  173 
1  m 

V2  •=   (m-1)  •  V1  =  173 

and  the  appropriate  value  of  Z  in  the  table  is  .125  for  the 
5$  level  of  significance.   Since  the  calculated  value  of 
Z  =  .6013  is  greater  than  the  tabulated  test  value,  W  is 
therefore  significantly  different  from  zero.   This  indicates 
that  we  can  reject  the  hypothesis  that  the  rankings  by  the 
students  are  unrelated  to  those  of  the  alumni.   A  teacher  who 
is  ranked  high  by  students  will  also  tend  to  be  ranked  high 
by  alumni. 


^Fisher,  R.  A.  and  Yates,  F.,  Statistical  Tables,  p.  50, 
Hafner,  1957. 
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A  second  study  was  conducted  to  determine  if  rankings 
of  the  faculty  were  stable  across  three  different  voting 
populations.   All  teachers  which  were  eligible  to  receive 
the  Award  for  Excellence  in  Teaching  and  were  known  by  at 
least  ten  students  in  1970,  1971,  and  1972  voting  were  ranked 
by  the  students  from  each  year. 

Table  XI  is  a  3  x  105  matrix  of  the  rankings  of  each 
teacher.   The  first  through  third  rows,  are  the  rankings  of 
students  from  1970,  1971,  and  1972  respectively. 

Again  using  the  coefficient  of  concordance  and  the  new 
computer  program  the  results  indicated  that 

12  (500957.  *D 

W  =  . 5 =  .577058 

(3T  ((105K  -  105)  (12  *  3  *  6) 

and  Z  =  1/2  loge  (m'^  ff  =   .2967 

The  appropriate  degrees  of  freedom  for  Z  are 

v1  =  (n-i)  -  |  =  ion. 3 

V2   =   (m-1)  •  V1   =   208.7 

and  the  appropriate  value  of  Z  in  the  table  is  .136  for  the 
5%   level  of  significance. 

Since  the  calculated  value  of  Z  =  .297  is  greater  than 
the  test  value,  W  is  significantly  different  from  zero.   This 
again  indicates  that  the  rankings  of  teachers  was  not  random 
and  that  a  teacher's  ranking  was  stable  across  years. 
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TABLE  X.   CONCORDANCE  MATRIX  1 


Alumni  1.0  2.0  3-0  4.5  6.0  7.0 
Student  31.0  32.0  66.0  26.0  23.0  38.0 
Total       32.0     34.0     69.0      30.5     27.5     44.0 


Alumni  9.0  10.0  11.0  12.0  13.0  14 . 0 
Student  13.0  24.0  48.0  29.0  19. 0  122.0 
Total       22.0     34.0     59.0     41.0     32.0    136. 0 


Alumni  15.0  16.0  17.0  19.0  19.0  19.0 
Student  145.0  9.0  10.0  .  2.0  84.0  102.0 
Total       160.0      25.0      27.0      21.0     103.0     121.0 


Alumni  21.0  22.0  23.0  24.0  25.0  26.5 
Student  63.0  1.0  21.0  107.0  136.5  70.0 
Total       84.0     23.0     44.0    133.0    161.5     96.5 


Alumni  28.0  29.0  30.0  31.0  32.0  33.0 
Student  79.0  82.5  86.0  57.0  8.0  146. 0 
Total      107.0    111.5    116.0     88.0     40.0    179.0 


Alumni  3^.0  35-0  36. 0  37.0  38. 0  39.0 
Student  6.0  68.5  '  95.0  51.0  152.0  141.0 
Total       40.0     103.5     131.0     88.0     190.0     180.0 


Alumni  40.0  41.5  41.5  43.0  44.0  45.0 
Student  17.0  73.0  46.0  99.5  5.0  32.0 
Total       57.0    114.5     87.5    142.5     49.0     79-0 


Alumni  46.0  47.0  48.0  49.0  50.5  50.5 
Student  20.0  114.0  91.0  22.0  54.0  78.0 
Total       66.0     161.0    139.0     71.0     104.5"     128.5 


Alumni  52.0  53.0  54.5  54.5  56.0  57-0 

Student  132.0  28.0  52.0  128.5  104.0  50.0 

Total  184.0  81.0  106.5  I83.O  160.0  107.0 

Alumni  58. 0  59.0  61.0  61.0  6l.O  63. 0 

Student  58. 0  71.0  59.0  68.5  7.0  11.0 

Total  116.0  130.0  120.0  129.5  68.0  74.0 
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TABLE  X. 

CONCORD AN 

CE  MATRIX 

1  (Cont 

inued) 

Alumni 

Student 

Total 

64.0 

53.0 

IlT.O 

65.0 

97.0 

162.0 

66.5 
35.0 

101.5 

66.5 

76.5 

14  3.0 

68.0 
15.0 
83.0 

69.0 
123-5 
192.5 

Alumni 

Student 

Total 

70.0 
61.0 

T31.0 

71.0 
117.0 
188.0 

73.0 
147.0 
220.0 

73.0 

30.0 

103.0 

73.0 
12.0 

85.0 

75.0 

89.0 

164.0 

Alumni 

Student 

Total 

77.0 

81.0 

158.0 

77.0 

39.0 

116.0 

77.0 
33.0 
80.0 

79.5 
•  94.0 

173.5 

79.5 

42.5 

122.0 

81.0 
138.0 
219-0 

Alumni 

Student 

Total 

82.5 

76.5 

159.0 

82.5 

18.0 

100.0 

84.5 

74.0 

158.5 

84.5 
90.0 

174.5 

86.5 
103.0 

189.5 

86.5 

55.0 

141.5 

Alumni 

Student 

Total 

88.0 
108.0 
196.0 

89.0 
110.0 
199.0 

90.5 
156.5 
227.0 

90.5 
164.5 
255.0 

92.0 
116.0 
208.0 

93.0 
148.0 
241.0 

Alumni 

Student 

Total 

9^.0 
14.0 

108.0 

95.0 

42.5 

127.5 

96.5 
' 120.0 

217.5 

96.5 

99.5 

196.0 

98.5 
85.0 

183.5 

98.5 
45.0 

143.5 

Alumni 

Student 

Total 

100.0 
164.5 
264.5 

101.0 

41.0 

142.0 

102.0 

88.0 

190.0 

103. 0 

66.0 
169.0 

104.0 
164.4 
268.5 

105.0 
134.0 
239.0 

Alumni 

Student 

Total 

106.0 

87.0 

193.0 

107-5 
164.5 
272.0 

107.5 

16.0 

123.5 

109-5 

49.0 

158.5 

109.5 
47.0 

156.5 

111.0 

105.0 
216.5 

Alumni 

Student 

Total 

112.5 
101.0 

213.5 

112.5 

92.0 

204.5 

114.0 
127.0 
241.0 

115.0 

36.0 

151.0 

116.0 
111.0 
227.0 

117.0 
112.0 
229.0 

Alumni 

Student 
Total 

118.0 

164.5 
282.5 

119.0 
128.5 
247.5 

120.5 

37.0 

157.5 

120.5 

96.0 

216.5 

122.0 

56.0 

178.0 

123.0 
133.0 
256.0 
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TABLE  X. 

CONCORDANCE  MATRIX 

1  (cone! 

Luded) 

Alumni 

Student 

Total 

12*1.5 

98.0 

222.5 

124.5 
44.0 

168.5 

126.0 

164.5 
290.5 

128.0 

27.0 

155.0 

128.0 

143-5 
271.5 

128.0 

60.0 

188.0 

Alumni 

Student 

Total 

131.0 
150.0 
281.0 

132.5 
164.6 
297.0 

132.5 

139.5 
272.0 

13^.0 

123.5 

257.5 

135.0 

33.0 

168.0 

136.0 

72.0 

208.0 

Alumni 

Student 

Total 

137.5 
142.0 

279.5 

137.5 
164.5 
302.0 

139.0 

66.0 

205.0 

130.0 
164.5 
304.5 

141.0 
119.0 
260.0 

142.0 
164.4 
306.5 

Alumni 

Student 

Total 

1^3.0 

75.0 
218.0 

144.0 
130.0 
274.0 

160.0 

164.5 
324.5 

160.0 
153.0 
313.0 

160.0 
109.0 
269.0 

160.0 
135.0 
295.0 

Alumni 

Student 

Total 

160.0 
126. Q 
286.0 

160.0 
151.0 
3H.0 

160.0 
121.0 
281.0 

160.0 
118.0 
278.0 

160.0 
164.5 
324.5 

160.0 

82.5 

242.5 

Alumni 

Student 

Total 

160.0 
164.5 
324.5 

160.0 
164.5 
324.5 

160.0 
113.0 
273.0 

160.0 

62.0 

222.0 

160.0 

40,0 

200.0 

160.0 
164.5 
324.5 

Alumni 

Student 

Total 

160.0 
139.5 
299.5 

160.0 

80.0 

240.0 

160.0 

93.0 

253.0 

160.0 
149.0 
309.0 

160.0 
164.5 
324.5 

160.0 
164.5 
324.5 

Alumni 

Student 

Total 

160.0 
125.0 
285.0 

160.0 

64.0 

224.0 

160.0 
105.5 
265.5 

160.0 
131.0 
291.0 

160.0 
164.5 
324.5 

160.0 
164.5 
324.5 

Alumni 

Student 

Total 

160.0 
164.5 
324.5 

160.0 
164  .5 
324.5 

160.  0 
164.5 
324.5 
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TABLE  XI.   CONCORDANCE  MATRIX  2 


Students 
Students 
Students 
Total 

r72 

'71 
•70 

1.0 

36.0 

1.0 

38.0 

2.0 
39.0 
18.0 
59.0 

3.0 
31.0 

2.0 
36.0 

4.0 

7.0 

8.0 

19.0 

5.0 

95.0 

7.0 

107.0 

6.0 
20.0 
25.0 
51.0 

Students 
Students 
Students 
Total 

'72 
'71 
'70 

7.0 
44.0 

13.0 
64.0 

8.0 

84.0 

14.0 

106.0 

9.0 

6.0 

34.5 

49.5 

10.0 

4.0 

10.0 

24.0 

11.0 
47.0 
23.0 
81.0 

12.0 
30.0 
40.0 
82.0 

Students 
Students 
Students 
Total 

'72 
'71 
'70 

13.0 
16.5 
36.0 
65.5 

14.0 

19.0 

5.0 

38.0 

15.0 

83.0 

22.0 

120.0 

16.0 

2.0 

15.0 

33.0 

17.0 

33.0 

57.0 

107.0 

18.0 
38.0 
16.0 
72.0 

Students 
Students 
Students 
Total 

'72 
'71 
'70 

19.0 
51.0 
28.0 
98. 0 

20.0 
101.0 

45.0 
166.0 

21.0 

57.0 

33.0 

121.0 

22.0 

72.0 

11.0 

105.0 

23.0 
13-0 
34.5 
70.5 

24.0 
29.0 
12.0 
65.0 

Students 
Students 
Students 
Total 

'72 
'71 
'70 

25.0 

60.0 

17-0 

102.0 

26.0 

24.0 

.  27.0 

77.0 

27.0 

48.0 

55.0 

130.0 

28.0 

80.0 

19.0 

127.0 

29.0 
18.0 
44.0 
91.0 

30.0 

76.0 

24.0 

130.0 

Students 
Students 
Students 
Total 

'72 
'71 
'70 

31.0 

66.0 

102.0 

199.0 

32.0 

52.5 
37.0 

121.5 

33.5 

21.0 

26.0 

TO.  5 

33.5 
12.0 

71.5 
117.0 

35.0 

8.0 

58.0 

101.0 

36.0 

82.0 

41.0 

159.0 

Students 
Students 
Students 
Total 

'72 

'71 
'70 

37.0 

92.0 

52.0 

181.0 

38.0 
71.0 
39.0 

148.0 

39.0 

40.5 
6.0 

85.5 

4  0.0 

84.5 

29.0 

153.5 

41.0 

56.0 

93.5 

190.5 

42.0 

10.0 

69.0 

121.0 

Students 
Students 
Students 
Total 

'72 
'71 
'70 

43-0 

97.0 

50.0 

190.0 

44.0 

90.0 

85.0 

219.0 

45.0 

67.5 
65.0 

177-5 

46.0 

32.0 

78.0 

156.0 

47.0 

63.0 

61.0 

171.0 

48.0 

74.0 

98.5 

220.5 

Students 
Students 
Students 
Total 

'72' 
'71 

'70 

49.0 

73.0 

77.0 

199.0 

50.0 

5.0 

42.0 

97.0 

51.0 

89.0 

91.0 

231.0 

52.0 

75.0 

20.0 

147.0 

53.0 

26.0 

100.0 

179.0 

54.0 

49.0 

101.  0 

204.0 
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TABLE  XI. 

CONCORDANCE  MATRIX  2  (Continued 

Students 
Students 
Students 
Total 

'72 
'71 
'70 

55.0 

5^.0 

63.0 

172.0 

56.0 

46.0 

38.0 

140.0 

57.0 

34.0 

76.0 

167.0 

58.0 

15.0 

53.0 

126.0 

59.0 

99.0 

62.0 

220.0 

60.0 

9.0 

81.0 

150.0 

Students 
Students 
Students 
Total 

'72 

'71 
'70 

61.0 

61.0 

103.0 

225.0 

62.0 

27.0 

30.0 

119.0 

63.0 

58.0 

31.0 

152.0 

64.0 

93-0 

3.0 

160.0 

65.0 

25.0 

70.0 

160.0 

66.0 

35.0 

32.0 

133.0 

Students 
Students 
Students 
Total 

'72 
'71 
'70 

67.0 

64.0 

54.0 

185.0 

68.5 

69.O 

92.0 

229.5 

68.5. 
43.0 

98.5 
210.0 

70.0 

50.0 

80.0 

200.0 

71.0 

96.0 

60.0 

227.0 

72.0 

65.O 

68.0 

185.0 

Students 
Students 
Students 
Total 

'72 
'71 

'70 

73.0 

1.0 

96.0 

170.0 

74.0 
100.0 

82.0 
256.0 

75.0 
11.0 

4  9.0 
135.0 

76.0 

98.0 

48.0 

222.0 

77.0 

86.0 

86.0 

249.0 

78.0 

22.0 

79.0 

179.0 

Students 
Students 
Students 
Total 

'72 
'71 
'70 

79.0 
103.5 

83.0 
265.5 

80.0 

52.3 
51.0 

183-.5 

81.0 
103.5 

97.0 
281.5 

82.0 

70.0 

64.0 

216.0 

83.0 

23.0 

95.0 

201.0 

84.0 

45.0 

67.O 

196.0 

Students 
Students 
Students 
Total 

'72 
'71 
'70 

85.0 

28.0 

46.0 

159.0 

86.0 
67.O 
75.0 
228.0 

87.0 

1.6.5 

9.0 

112.5 

88.0 

37.0 

47.0 

172.0 

89.0 

88.0 

74.0 

251.0 

90.0 

59.0 

93.5 

242.5 

Students 
Students 
Students 
Total 

'72 
'71 
'70 

91.0 
105.0 

71.5 
267.5 

92.0 

91.0 

66.0 

249.0 

93.0 

14.0 

43.0 

150.0 

94.0 

55.0 

89.0 

238.0 

95.0 

42.0 

73.0 

210.0 

96.0 

62.0 

90.0 

248.0 

Students 
Students 
Students 
Total 

'72 
'71 
'70 

97.0 

77.0 

59.0 

233.0 

98.0 

94.0 

105.0 

297.0 

99.0 

81.0 

84.0 

264.0 

100.0 
87.0 
87.0 

274  .0 

101.0 
79.0 
56.0 

236.0 

102.0 
3.0 
4.0 

109.0 

Students 
Students 
Students 
Total 

'72 
'71 

'70 

103.0 
40.5 

21.5 
164.  cj 

104.0 
78.0 
88.0 

270.0 

105.0 
102.0 
104.0 
311.0 
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APPENDIX  A 

THE  REAR  ADMIRAL  JOHN  J.  SHISFFFLIN  AWARD 
FOR  EXCELLENCE  IN  TEACHING 


In  order  to  augment  the  existing  incentives  for  teaching  of  high 
quality,  an  award  for  Excellence  in  Teaching  has  been  established  by 
the  Superintendent.  A  substantial  stipend  was  made  possible  through 
a  gift  to  the  Naval  Postgraduate  School  Foundation  in  honor  of  Rear 
Admiral  John  J.  Shieffelin,  USII.   The  .judgments  of  those  who  have 
participated  in  the  educational  processes  at  the  Naval  Postgraduate 
School  are  of  primary  importance  in  determining  the  recipient.   This 
poll  is  being  conducted  to  assess  the  collective  opinion  of  students, 
faculty,  staff,  and  selected  alumni.  After  accumulating  and  processing 
the  voting  results ,  the  Selection  Committee  will  recommend  an  Awardee 
to  the  Superintendent. 

A  meaningful  selection  of  the  Award  receipient  is  heavily  dependent 
upon  input  from  a  large  portion  of  the  eligible  voters .   Your  response 
is  therefore  earnestly  requested.   Please  complete  the  enclosed 
ballot  in  accordance  with  the  instructions  below.   The  results  of  the 
polling,  other  than  the  name  of  the  Award  recipient,  will  be  treated 
as  privileged  information. 

BALLOTING  PROCEDURE: 

Step  1.  Complete  the  information  requested  at  the  top  (Part  A)  of  the 
ballot.  These  items  are  for  purposes  of  statistical  analyses 
only. 

Step  2.   On  the  list  of  eligible  faculty  (Part  C),  encircle  the 

four-digit  identification  number  at  the  left  of  all  those 
with  whom  you  are  sufficiently  acquainted  to  make  a  judgment. 
For  purposes  of  establishing  a  valid  population  base,  it 
is  important  to  encircle  all  with  when  you  are  acquainted. 
If  you  have  circled  five  or  mere  numbers  on  the  ballot,  proceed 
to  Step  3-   Otherwise,  please  return  your  ballot  as  directed 
in  Step  5- 

Step  3«   From  the  subset  of  faculty  you  have  indicated  in  Step  2, 
select  from  one  (l)  to  three  (3)  nominees.   Indicate  your 
preferences  in  .?r :"-?:-  cy  :  lacing  the  four -digit  identification 
numbers  of  your  r::.::.:''-.--es  f:r  firsx.  s e cond  and  third  choices 
in  the  appropriate     es  proviued  in  Part  3. 

Step  k.     You  are  invited  to  furnish  a  short  statement  in  support  of 

your  primary  nomination.   Indicate  those  qualities  which,  in 
your  judgment,  make  him  an  outstnading  teacher.   Space  is 
provided  for  this  at  the  end  (Part  D)  of  the  ballot. 


Step  5.   Place  your  completed  ballot  in  the  enclosed  return  envelope, 
sign  the  envelc      :  retur  i  ballots  must  be 

received  by '15  April  1972.  Ball  separatee 

the  envelopes . 
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BALLOT 


Part  A  -  Statistical  (encircle  code  at  left) 


Military 

Rank 

Branch  of  Service 

Cur 

ricular  Area 

01 

N 

Navy 

30 

Ops  Analysis 

02 

M 

Marine  Corps 

31 

Aero  Eng 

03 

A 

Ar  mi- 

32 

Elec  &  Comm  Eng 

ou 

C 

Coast  Guard 

33 

Ordnance 

05 

L 

Air  Force 

3h 

Naval  Eng 

06 

F 

Foreign 

35 

Env  Sci 

07 

36 
37 
38 
39 

Mange  &  Compt  Sci 
Eng  Sci 
Baccalaureate 
Def  Management 

S  Student 

F  Faculty 

gory 

A  Alumnus 

C  Curricular  Officer 

Civilian 

Rank 

Department 

IR 

Instructor 

AE 

Aeronautics 

AT 

Assist  Prof 

A0 

Aviation  Safety 

AC 

Assoc  Prof 

MS 

Bus  Ad  &  Econ 

RP 

Professor 

EE 

Elec  Eng 

GH 

Govt  &  Humanities 

MC 

Mat  Sc  &  Chem 

MA 

Math 

ME 

Mech  Eng 

MR 

Meteorology 

0C 

Oceanography 

0A 

Ops  Analysis 

PH 

Physics 

.on  number) 

Third  Choice 

NS 

Navy  Mange  Sys  Center 

Part  B  -  Nominations  (use  the  four -digit  identification  number) 

First  Choice  Second  choice 

Part  C  -  List  of  Eligible  Faculty  (i.e.,  all  faculty  who  taught  two  or  more  course  segments  in  calendar 

year  1971,  except  Department  Chairmen,  Curricular  and  Liaison  Officers,  members  of  the  Selection 
Committee  and  past  recipients  of  the  Award. 


Aviation  Safety  Programs 

101U  Bomberger,  R.  B. 

1025  Bradbury,  C.  M. 

5016  Brenson,  J.  J. 

10^7  Wible,  L.  C. 
Department  of  Aeronautics 

5027  Bank,  M.  H. 

1069  Bennett,  J.A.J. 

1070  Biblarz,  0. 
1081  Collins,  D.  J. 

5038  Fuhs,  A.  E. 

1092  Gawain,  T.  H. 

1108  Haupt,  U. 

50U9  Hess,  R.  A. 

1119  Kahr,  C.  H. 

1120  Layton,  D.  M. 

1131  Lindsey,  G.  H. 

11U2  Miller,  J.  A. 

1153  Netzer,  D.  W. 

II6I4  Platzer,  M.  F. 

5050  Power,  H.  L. 

1175  Redlin,  M.  H. 

1186  Schmidt,  L.  V. 

1203  Zucker,  R.  D. 

Department  of  Electrical 
Engineering 

lU8l  Adler,  R.  W. 

5061  Bach,  R. 

1508  Bauer,  W.  M. 

1519  Baycura,  0.  M. 

1531  Bouldry,  John  M. 

15^2  Breida,  S. 

1553  Campbell,  J.  D. 
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